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DETAILED ACTION 

Drawings 

The drawings are objected to because the handwritten corrections on at least 
Figure 2 are illegible. Corrected drawing sheets in compliance with 37 CFR 1.121(d) 
are required in reply to the Office action to avoid abandonment of the application. Any 
amended replacement drawing sheet should include all of the figures appearing on the 
immediate prior version of the sheet, even if only one figure is being amended. The 
figure or figure number of an amended drawing should not be labeled as "amended." If 
a drawing figure is to be canceled, the appropriate figure must be removed from the 
replacement sheet, and where necessary, the remaining figures must be renumbered 
and appropriate changes made to the brief description of the several views of the 
drawings for consistency. Additional replacement sheets may be necessary to show the 
renumbering of the remaining figures. Each drawing sheet submitted after the filing date 
of an application must be labeled in the top margin as either "Replacement Sheet" or 
"New Sheet" pursuant to 37 CFR 1 .121(d). If the changes are not accepted by the 
examiner, the applicant will be notified and informed of any required corrective action in 
the next Office action. The objection to the drawings will not be held in abeyance. 

Figures 1-3 should be designated by a legend such as --Prior Art-- because only 
that which is old is illustrated. See MPEP § 608.02(g). Corrected drawings in 
compliance with 37 CFR 1 .121(d) are required in reply to the Office action to avoid 
abandonment of the application. The replacement sheet(s) should be labeled 
"Replacement Sheet" in the page header (as per 37 CFR 1 .84(c)) so as not to obstruct 
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any portion of the drawing figures. If the changes are not accepted by the examiner, the 
applicant will be notified and informed of any required corrective action in the next Office 
action. The objection to the drawings will not be held in abeyance. 

Specification 

The abstract of the disclosure is objected to because the inventor's name 
appears as the first line of the abstract, where the remainder of the abstract is a 
separate paragraph. The examiner respectfully requests that the inventor's name be 
removed from the abstract page. Correction is required. See MPEP § 608.01(b). 
Claim Objections 

Claims 1 and 4 are objected to because of the following informalities: Claim 1 
initially describes a tap window size of N ta ps, but later describes the variable as N Ta ps, 
where the T in taps is capitalized. The examiner respectfully requests that the variable 
Ntaps be consistently written throughout the claim, in order to avoid any confusion as to 
whether or not the same variable is being described throughout the claim. 

The fourth line of claim 4 reads, "storing output words in the frame buffer for the 
plurality of scaled video lines ", it should read, "storing output words in the frame buffer 
for the plurality of scaled video lines; ", where a semicolon is included at the end of the 
limitation. 

Appropriate correction is required. 
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Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

Claims 1, 3, 10-12, 16 and 17 are rejected under 35 U.S.C. 102(b) as being 
anticipated by Law (US 5,671,020). 

RE claim 1 , Law describes a method of image scaling using an array of 
processing elements, wherein the processing elements are arranged from a first 
processing element to an nth processing element (Figure 3A and 6:35-7:32 describes a 
prior art method and system horizontally decimating (scaling) an image using a plurality 
of processing elements PPE0-PPE7), and wherein the image scaling uses a tap window 
size of Ntaps, (7:6-32 describes using a three tap filter) the method comprising: 

(a) loading a frame buffer with pixel values from a video line, the pixel values in 
the loaded frame buffer being arranged into words having a width of n input pixel values 
(1 :43-65 describes storing pixel values in raster scan format in a memory, retrieving the 
pixel values from the memory so the system may perform preprocessing operations, 
such as hierarchical decimation, and then storing the newly computed pixel values back 
into the memory. The described memory is considered a frame buffer as it stores, pixel 
by pixel, the contents of an image. Further, the pixel values are stored in raster scan 
format, which the examiner considers pixel values that are arranged into words having a 
width of some number of input pixel values); and 
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(b) broadcasting N ta ps words from the loaded frame buffer to the array (1 :43-65 
describes that pixel data may be retrieved from the memory such that hierarchical 
decimation may be carried out on the pixel data), 

wherein for each word, the input pixel values are arranged from a first input pixel 
value to an nth input pixel value such that, for each word broadcast to the array, the first 
processing element processes the first input pixel value in the word, the second 
processing element processes the second input pixel value in the word, and so on, and 
wherein the broadcast order of the pixel values is such that each processing element is 
configured to process the N tap s input pixels it receives from the frame buffer into a 
scaled output pixel value using the same multiply-and-accumulate coefficient set, the 
processing elements thereby producing an output word of n scaled pixel values (Figure 
3A and 6:35-7:32 describes that the retrieved pixel values are stored in a memory buffer 
302, where once the pixels are stored in the memory buffer 302 a crossbar network 306 
directs selected pixels to the proper processing elements PPE0-PPE7. Each 
processing element comprises a three tap filter with coefficients k1 , k2, and k3 and 
three consecutive pixels are provided to each of the processing elements PPE0-PPE7, 
one at a time, where each processing element performs a multiply and accumulate 
operation. Each processing element then outputs an output pixel value that is the 
weighted average of the input pixel values. Thus, the set of processing elements PPE0- 
PPE7 outputs an output word of n scaled pixel values, where in this case n=8). 

RE claim 3, Law describes the method of claim 1 , further comprising: 
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(c) repeating act (b) to produce a succession of output words from the array of 
processing elements, wherein the succession of output words represents a horizontally- 
scaled version of the video line (7:48-54 describes that the process for calculating 
output pixel values according to equation (1 ) is repeated for all pixels of each picture 
until all pictures are processed). 

RE claim 10, Law describes an image processor, comprising: 

an array of processing elements arranged from a first processing element to an 
nth processing element (Figure 3A and 6:35-7:32 describes PPE0-PPE3); 

a frame buffer storing input words of n pixel values in length (1 :43-65 describes 
that pixel data is stored in raster scan format in a memory such as a RAM. The pixel 
data can be retrieved from the RAM, preprocessed, such as a hierarchical decimation 
processing operation, and then stored back into the RAM. The RAM is thus considered 
a frame buffer, as it stores, pixel by pixel, data for an image. The RAM is also 
considered to store the pixel data as words having a width of some number of pixels), 

the image processor being configured such that input words from the frame 
buffer may be successively broadcast to the array of processing elements, wherein the 
first processing element receives the first pixel value from a broadcast input word, the 
second processing element receives the second pixel value from the broadcast input 
word, and so on, the processing elements being configured to perform multiply-and- 
accumulate (MAC) operations on the received values such that after the broadcast of 
Ntaps words from the frame buffer, each processing element may provide a scaled 
output pixel value using the same MAC coefficient set, the array of processing elements 
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thereby producing an output word of n scaled output pixel values (Figure 3A and 6:35- 
7:32 describes processing elements PPE0-PPE3, which input pixel data retrieved from 
memory and perform MAC operations on the received values in order to produce an 
output word of n scaled output pixel values). 

RE claim 1 1 , Law describes the image processor of claim 1 0, wherein the image 
processor is configured such that the output word may be stored in the frame buffer 
(1 :43-65 describes that once the hierarchical decimation is complete the new pixel data 
is stored back into the memory it was retrieved from). 

RE claim 12, Law describes the image processor of claim 1 0, wherein the output 
word is a horizontally-scaled output word (7:6-32 describes horizontal decimation 
(scaling) of the input pixel words to form an output word). 

RE claim 16, Law describes the image processor of claim 1 0, further comprising 
one or more additional arrays of processing elements, the frame buffer being arranged 
to successively broadcast input words to the one or more additional arrays such that the 
one or more additional arrays may also each provide an output word of scaled pixel 
values, wherein each scaled pixel value in the output word from the one or more 
additional arrays is calculated using the same multiply-and-accumulate coefficient set 
(Figure 3A and 6:35-7:32 describes PPE4-PPE7, which is considered one or more 
additional arrays of processing elements). 

RE claim 1 7, Law describes the image processor of claim 1 0, wherein the 
processing elements are reconfigurable processing elements (1 :43-2:1 1 describes that 
the processor that contains the plurality of processing elements (PPEs) is a vector 
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processor or a vector computer. Further, 5:8-22 describes filter 1 06 (considered 
identical in scope to the described vector processor) as a programmable filter. Thus, 
the processing elements are considered to be programmable). 

Claim Rejections - 35 USC § 103 
The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 2, 13, and 14 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Law in view of Lippincott (US 6,724,948). 

RE claims 2 and 14, Law describes a video filter that horizontally decimates an 
image (Figure 3A and 6:35-7:32), and further describes that vertical and temporal 
decimation are also contemplated (2:12-17). 

Law doesn't describe the method of claim 1 , further comprising: 

vertically-scaling pixels from a set of video lines to produce scaled pixel values 
for the video line, wherein the pixel values loaded into the frame buffer in act (a) are the 
vertically-scaled pixel values, and wherein the scaled output pixel values from each 
processing element in act (b) are both horizontally-scaled and vertically-scaled output 
pixel values. 

However, Lippincott describes a method comprising vertically scaling an image 
followed by horizontally scaling an image, wherein a four tap filter vertically scales and 
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stores the image and then reads the stored vertically scaled image and horizontally 
scales the vertically scaled image to create a final scaled image (2:45-3:35). 

All the elements of claim 2 are known in Law and Lippincott, the only difference is 
the combination of known elements into a single system and method. 

Thus, it would have been obvious to one of ordinary skill in the art at the time of 
the invention to include in Law the method of vertically-scaling pixels from a set of video 
lines to produce scaled pixel values for the video line, wherein the pixel values loaded 
into the frame buffer in act (a) are the vertically-scaled pixel values, and wherein the 
scaled output pixel values from each processing element in act (b) are both horizontally- 
scaled and vertically-scaled output pixel values, as suggested by Lippincott, as this 
doesn't change the operation of the system disclosed in Law, and it could be used to 
achieve the predictable result of scaling an image both vertically and horizontally, which 
has the advantage that it allows the output image to be displayed on a wider range of 
display devices. 

RE claim 13, Law describes a video filter that horizontally decimates an image 
(Figure 3A and 6:35-7:32), and further describes that vertical and temporal decimation 
are also contemplated (2:12-17). 

Law doesn't describe the image processor of claim 10, wherein the output word 
is a vertically-scaled output word. 

However, Lippincott describes a system and method of vertically scaling an 
image (2:45-3:35 describes vertically scaling an image, storing the scaled image, and 
then reading and horizontally scaling the stored vertically scaled image). 
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All the elements of claim 13 are known in Law and Lippincott, the only difference 
is the combination of known elements into a single system and method. 

Thus, it would have been obvious to one of ordinary skill in the art at the time of 
the invention to include in Law the system and method wherein the output word is a 
vertically-scaled output word, as taught by Lippincott, as this doesn't change the 
operation of the system disclosed in Law, and it could be used to achieve the 
predictable result of scaling an image both vertically and horizontally, which has the 
advantage that it allows the output image to be displayed on a wider range of display 
devices. 

Claims 4, 5, and 15 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Law in view of Deierling (US 6,239,847). 

RE claim 4, Law describes the method of claim 3, further comprising: 

repeating acts (a) through (c) to produce a succession of output words for a 
plurality of horizontally-scaled video lines (7:48-54); and 

storing the output words in the frame buffer for the plurality of scaled video lines 
(1 :43-65); 

Law contemplates vertically scaling images (2:12-17) but doesn't describe 
successively broadcasting sets of pixel values from the plurality of scaled video lines 
stored in the frame buffer to the array of processing elements; and 

processing the sets of pixel values in the array of processing elements to 
produce a set of vertically-scaled output words. 
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However, Deierling describes horizontally scaling input pixel data, storing the 
scaled pixel data in memory, reading the scaled pixel data from the memory and 
vertically scaling the horizontally scaled pixel data to produce output data (Figure 2 and 
3:37-4:6). 

All the elements of claim 4 are known in Law and Deierling, the only difference is 
the combination of known elements into a single system and method. 

Thus, it would have been obvious to one of ordinary skill in the art at the time of 
the invention to include in Law successively broadcasting sets of pixel values from the 
plurality of (horizontally) scaled video lines stored in the frame buffer to the array of 
processing elements; and processing the sets of pixel values in the array of processing 
elements to produce a set of vertically-scaled (and horizontally scaled) output words, as 
taught by Deierling, as this doesn't change the operation of the system disclosed in 
Law, and it could be used to achieve the predictable result of scaling an image both 
vertically and horizontally, which has the advantage that it allows the output image to be 
displayed on a wider range of display devices. 

RE claim 5, Law in view of Deierling doesn't describe the method of claim 4, 
further comprising: 

re-ordering the vertically-scaled output words to provide a horizontally and 
vertically scaled video line. 

However, if the system disclosed in Law (Figure 3A and 6:35-7:32) is used to 
carry out vertical scaling, where the vertically oriented input pixel words are transposed 
such that they are horizontally distributed among the rows in memory module 302, it 
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would have been obvious to one of ordinary skill in the art at the time of the invention to 
re-order the vertically scaled output words such that the horizontally and vertically 
scaled pixels are transposed back into their original vertical orientation before being 
stored into memory, as a horizontally and vertically scaled output image is only useful to 
a user if the scaled pixels are in the correct order. 

RE claim 1 5, Law doesn't describe the image processor of claim 1 0, wherein the 
input words are horizontally-scaled words and the output words are both horizontally 
and vertically scaled words. 

However, Deierling describes a system and method of using an n-tap filter to 
horizontally scale an image, and then using the same n-tap filter to input the horizontally 
scaled image in order to vertically scale the horizontally scaled image, which produces 
horizontally and vertically scaled output pixels (2:37-4:7). 

See the rejection of claim 4 for rationale to combine Deierling with Law, as the 
same rationale applies here. 

Claim 6 is rejected under 35 U.S.C. 103(a) as being unpatentable over Law. 

RE claim 6, Law describes the method of claim 1 , wherein the number of input 
pixel values in the video line is an integer multiple Ni of n (7:6-32 describes that an initial 
16 pixels are distributed along the bottom row of memory modules 302a-p and the next 
16 pixels are distributed on a second row. Thus, the number of input pixel values in the 
video line of data stored in buffer 302 is 32, which is an integer multiple of the number of 
processing elements, which is 8 (Nj=4)), and wherein the number of output pixel values 
in a scaled video line is an integer multiple N h of n (7:29-32 describes that the horizontal 
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decimation reduces the number of input pixels by half. Thus, the input pixels have been 
reduced from 32 to 16, which is an integer multiple of 8 (N h =2)), the broadcast order in 
act (b) being every Njth-1 input pixel (7:7-32 describes that three pixels are sent to each 
processing element in three successive broadcasts, where the third pixel of a first 
processing element is also the first pixel of an adjacent second processing element, 
thus, the broadcast order is every Njth-1 input pixel (where Ni = 4)), the scaled output 
pixel values from each multiply-and-accumulate calculation cycle being spaced apart by 
N h pixel values (7:19-32 describes that the three tap filter computes pixel values for 
every other pixel, thus the output pixels are spaced apart by N h pixels, as the new pixels 
correspond to every second pixel position of the old pixels). 

Law doesn't describe that the broadcast order in act (b) is every Nith input pixel. 

However, it would have been obvious to one of ordinary skill in the art at the time 
of the invention to include in Law a system and method wherein the broadcast order is 
every Nith input pixel, as opposed to every Njth-1 input pixel, as the applicant has not 
disclosed that broadcasting every Nith pixel as opposed to broadcasting every Njth-1 
pixel to each processing element provides an advantage, solves any stated problem, or 
is for any particular purpose, and it appears that the device would perform equally well 
when broadcasting the Nith or the Njth-1 input pixel to each processing element, as the 
only difference would be the fact that broadcasting the Nith pixel results in a 3:1 
compression of the pixel data while broadcasting the Njth-1 pixel results in a 2:1 
compression of the pixel data. Accordingly, broadcasting the Njth input pixel to each 
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processing element as opposed to broadcasting the Njth-1 input pixel is deemed to be a 
design consideration which fails to patentably distinguish over the prior art of Law. 

Claims 7-9 are rejected under 35 U.S.C. 103(a) as being unpatentable over Law 
in view of Adams et al. (US 6,380,978). 

RE claims 7 and 8, Law doesn't describe but Adams describes the method of 
claim 1 , wherein the number of input pixel values in the video line is not an integer 
multiple of n or wherein the number of output pixel values in each scaled video line is 
not an integer multiple of n (Figures 22, 28, and 29 and 1 7:44-59 and 20:1 1 -44 
describes a method for filtering an image. The method includes using a processing 
matrix to evaluate the pixels surrounding a pixel of interest. When the processing 
matrix reaches a top edge or a bottom edge and no pixel data exists for some of the 
values required for the processing matrix the system automatically adds rows of zero 
data, and when the processing matrix reaches the left or right edge the system 
automatically copies the left-most or right-most column and extends the width of the grid 
of pixels, in order to compensate for the missing pixel values. The teachings in Adams 
can easily be applied to Law in order to compensate for situations where either the 
number of input pixels or the number of scaled output pixels in a video line is not an 
integer multiple of n. 

All the elements of claims 7 and 8 are known in Law in view of Adams, the only 
difference is the combination of known elements into a single system and method. 

Thus, it would have been obvious to one of ordinary skill in the art at the time of 
the invention to deal with the situations wherein the number of input pixel values in the 
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video line is not an integer multiple of n or wherein the number of output pixel values in 
each scaled video line is not an integer multiple of n, as described in Adams, as this 
doesn't change the overall operation of the system disclosed in Law, and it could be 
used to achieve the predictable result of a more robust scaling program that is able to 
automatically compensate for missing rows or columns of pixels. 

RE claim 9, Law doesn't describe but Adams describes the method of claim 1 , 
further comprising: 

loading the frame buffer with padded video lines comprised of zero values, 
wherein when act (b) calculates output pixel values using input pixel values that are 
outside of the video line, zero values from the padded video lines are used (Figures 28 
and 29 and 20:1 1-44 describes that when a top or bottom row of nonexistent pixel data 
is required for successful processing by the processing matrix the system automatically 
generates a row of zero data to act as a substitute for the nonexistent upper/lower pixel 
data). 

See the rejection of claims 7 and 8 for rationale to combine Law with Adams, as 
the same rationale applies here. 

Conclusion 

The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. Miyaguchi (US 5,600,582) describes horizontally decimating an 
image using an array of processing elements. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to DANIEL WASHBURN whose telephone number is 
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(571)272-5551 . The examiner can normally be reached on Monday through Friday 8:30 
a.m. to 5:00 p.m.. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Ulka Chauhan can be reached on (571) 272-7782. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/Dan Washburn/ 
Examiner, Art Unit 2628 
3/19/08 

/Ulka Chauhan/ 

Supervisory Patent Examiner, Art Unit 2628 



